Scenario generation system, scenario generation method and scenario generation program

ABSTRACT

A scenario generation system, a scenario generation method, and a scenario generation program are provided. A scenario generation system used for video playback synchronized with musical piece playback includes a situation estimating portion for estimating a situation expressed by the musical piece, a video specifying portion for specifying at least one video suited for the estimated situation in the video constituted by scenes each having a time-series order, and a scenario generating portion for generating a scenario associating the scenes constituting the specified video with each section of the musical piece. As a result, a scenario can be generated by the scenes each having the time-series order, and the synchronized video with a natural impression can be reproduced corresponding to the musical piece playback on the basis of the scenario.

TECHNICAL FIELD

The present invention relates to a scenario generation system, ascenario generation method, and a scenario generation program forgenerating a scenario used for image reproduction synchronized withmusical piece reproduction.

BACKGROUND ART

In a currently used Karaoke system, a background image of a musicalpiece and lyrics is reproduced on a display screen. The background imageis seen not only by a singer but also by those present at the site andis required to be an image suitable for the musical piece.

For example, the device described in Patent Literature 1 generates abackground image by connecting motion data to each other, using themotion data selected on the basis of the musical piece as a target whenan image content is generated according to a change of the music of themusical piece.

The system described in Patent Literature 2 allows users to enjoyKaraoke while displaying a Karaoke background image with a wide variety,by generating the Karaoke background image using a plurality of imagesextracted from various images uploaded from a mobile phone or the likewhen Karaoke is used.

The device described in Patent Literature 3 generates an image inaccordance with meaning of lyrics emerging with progress of a reproducedmusical piece. The above device outputs a selected desirable reproducedmusical piece and generates the image in which characters are changed inaccordance with emotions such as intonation.

The system described in Patent Literature 4 enables intermittentreproduction of a long story image with Karaoke performance and performsintermittent reproduction in parallel with image data in a time divisionmanner.

CITATION LIST Patent Literature

-   PTL 1: Japanese Patent Laid-Open No. 2010-044484-   PTL 2: Japanese Patent Laid-Open No. 2011-075701-   PTL 3: Japanese Patent Laid-Open No. 2004-354423-   PTL 4: Japanese Patent Laid-Open No. 2003-108155

Non Patent Literature

-   NPL 1: “A Proposal for Synchronized Web Image and Music Reproduction    System using Lyrics” by Shintaro Funasawa, Hiromi Ishizaki,    Keiichiro Hoashi, Yasuhiro Takishima, Jiro Katto, FIT2009, The    8^(th) Forum on Information Technology, Lecture Paper Collection,    Information Processing Society of Japan, Institute of Electronics,    Information and Communication Engineers, Aug. 20, 2009, Second Vol.,    pp. 333 to 334-   NPL 2: “A study on Music Section for Music Retrieval based on    Lyrics” by Shintaro Funasawa, Hiromi Ishizaki, Keiichiro Hoashi,    Yasuhiro Takishima, Jiro Katto, The 71^(st) National Assembly of    Information Processing Society of Japan, 5R-2 (2009).-   NPL 3: Thorsten Joachims, “SVMLIGHT”, [online], Aug. 14, 2008,    Cornell University, [searched on Jun. 18, 2013], Internet <URL:    http://svmlight.joachims.org/>-   NPL 4: “Mecab”, [online], [searched on Jun. 18, 2013], Internet    <URL: http://mecab.googlecode.com/svn/trunk/mecab/doc/index.html>

SUMMARY OF INVENTION Technical Problem

However, in the devices described above, it is difficult to generatevarious background images by combining material images stored in adatabase. That is, a synchronized image cannot be reproduced with animage suitable for each section of musical pieces in the ordermaintaining a time series, and the synchronized images with a naturalimpression corresponding to the musical piece reproduction cannot bereproduced. As a result, it becomes difficult to ensure storycharacteristics in the background image by changing the background imagein accordance with contents of lyrics of the musical piece.

The present invention was made in view of these circumstances and has anobject to provide a scenario generation system, a scenario generationmethod, and a scenario generation program that can generate a scenarioby scenes having a time-series order and reproduce the synchronizedimage with a natural impression corresponding to musical piecereproduction.

Solution to Problem

(1) In order to achieve the aforementioned object, the scenariogeneration system of the present invention is a scenario generationsystem used for image reproduction synchronized with musical piecereproduction including: a situation estimating portion for estimating asituation expressed by the musical piece; an image specifying portionfor specifying at least one image suited for the estimated situationfrom the images constituted by scenes having a time-series order; and ascenario generating portion for generating a scenario associating thescenes constituting the specified image with each section of the musicalpiece. As a result, a scenario can be generated by the scenes having atime-series order, and the synchronized image with a natural impressioncorresponding to the musical piece reproduction can be reproduced on thebasis of the scenario.

(2) Moreover, in the scenario generation system of the presentinvention, the scenario generating portion generates a scenarioassociating the scene of the specified image with each section of themusical piece while maintaining the time-series order. As a result, itis possible to further generate the scenario of the synchronized imagein which the image is matched with each section of the musical piece canbe generated while maintaining the time-series order of the originalimage scene.

(3) Moreover, in the scenario generation system of the presentinvention, the situation estimating portion estimates a situationexpressed by the musical piece by analyzing lyrics of the musical piece.As described above, it is possible to cause an image accurately matchingthe musical piece to correspond by analyzing the lyrics of the musicalpiece.

(4) Moreover, the scenario generation system of the present inventionfurther includes an adjustment image specifying portion for extracting akeyword from the lyrics of the musical piece for each section of themusical piece and for specifying an adjustment image using the extractedkeyword, and a scenario adjustment portion for adjusting the scenario byusing the adjustment image while maintaining the time-series order ofthe scenes specified in the scenario. As a result, the original scenariois complemented by using the adjustment image, and diversified and moreappropriate scenario of the synchronized image can be generated.

(5) Moreover, in the scenario generation system of the presentinvention, the situation estimating portion estimates a situationexpressed by a musical piece by estimating contents of each categorycorresponding to the situation expressed by the musical piece. As aresult, it is possible to perform appropriate matching with the image byestimating the situation expressed by the musical piece with 5W1H aseach category, for example.

(6) Moreover, in the scenario generation system of the presentinvention, the image adjusting portion compares the scene specified inthe scenario with the adjustment image for each section of the musicalpiece on the basis of a reference set in advance and adopts either oneof them as the scene newly specified in the scenario. As a result, it ispossible to produce a scenario by adopting favorable image more suitablefor the musical piece.

(7) Moreover, the scenario generation system of the present inventionfurther includes an evaluation information collecting portion forcollecting evaluations on a synchronized image by the generated scenariofrom viewers of the synchronized image and for storing the collectedevaluations in the evaluation information DB, and an evaluationinformation DB for storing the collected evaluations, and the imageadjustment portion modifies a combination of the scenes specified in thescenario on the basis of the evaluation information stored in theevaluation information DB. As a result, it is possible to generate thescenario by reflecting the user's evaluation.

(8) Moreover, the scenario generation system of the present inventionincludes a reproduction portion for reproducing the synchronized imageon the basis of the generated scenario. As a result, it is possible toreproduce the synchronized image suitable for the musical piece andgenerated by automatically combining the image. It can be used for thebackground image of Karaoke, for example.

(9) Moreover, the scenario generation method of the present invention isa scenario generation method for generating a scenario used for imagereproduction synchronized with musical piece reproduction, the scenariogeneration method including the steps of: estimating a situationexpressed by a musical piece; specifying at least one image suited forthe estimated situation in image constituted by scenes having atime-series order; and generating a scenario associating the scenesconstituting the specified image with each section of the musical piece.As a result, it is possible to produce a scenario by the scenes eachhaving the time-series order, and to reproduce the synchronized imagewith a natural impression corresponding to the musical piecereproduction on the basis of the scenario.

(10) Moreover, the scenario generation program of the present inventionis a scenario generation program for generating a scenario used forimage reproduction synchronized with musical piece reproduction, thescenario generation program causing a computer to execute the processesof: estimating a situation expressed by a musical piece; specifying atleast one image suited for the estimated situation in image constitutedby scenes having a time-series order; and generating a scenarioassociating the scenes constituting the specified image with eachsection of the musical piece. As a result, it is possible to produce ascenario by the scenes each having the time-series order, and toreproduce the synchronized image with a natural impression correspondingto the musical piece reproduction on the basis of the scenario.

Advantageous Effects of Invention

According to the present invention, it is possible to produce a scenarioby the scenes each having the time-series order, and to reproduce thesynchronized image with a natural impression corresponding to themusical piece reproduction on the basis of the scenario.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of a scenariogeneration system of the present invention.

FIG. 2 is a flowchart illustrating an operation of the scenariogeneration system of the present invention.

FIG. 3 is a view illustrating a processing image of generation andadjustment of a scenario.

FIG. 4 is a view illustrating a relationship between meta information onan entire image and meta information of each scene.

FIG. 5 is a view illustrating a table associating an image material withthe meta information.

FIG. 6 is a flowchart illustrating a processing example of musical piecesituation information estimation.

FIG. 7 is a view schematically illustrating estimation processing of animpression received from lyrics.

FIG. 8 is a table illustrating an example of categories set in advanceand words expressing a state of each category.

FIG. 9 is a schematic view illustrating an example of processing ofspecifying image.

FIG. 10 is a table illustrating a scenario format example.

DESCRIPTION OF EMBODIMENTS

Subsequently, an embodiment of the present invention will be describedby referring to the attached drawings. In order to facilitateunderstanding of the description, the same reference numerals are givento the same constituent elements in each figure, and duplicateddescription will be omitted.

(Configuration of Scenario Generation System)

The scenario generation system of the present invention generates ascenario used for image reproduction synchronized with musical piecereproduction. That is, a pivotal image is selected on the basis ofmusical piece situation information (5W1H information, for example)estimated from musical piece lyrics, and the pivotal image and theadjustment image specified by a keyword extracted from lyrics lines arecombined so that a scenario constituting background image correspondingto contents of the musical piece lyrics is generated. The scenario is animage playlist for reproduction by combining a plurality of imagescorresponding to the contents when the image is generated insynchronization with the lyrics.

(Configuration of Each Portion)

FIG. 1 is a block diagram illustrating a configuration of a scenariogeneration system 100. An image DB 110 stores image materials. Each ofthe images is given meta information in advance. The meta information isgiven to the entire image materials or to each scene, for example, andinformation included in the image such as details of a person, a season,and a time slot is associated with each other as text information andstored. The scene means a plurality of short images constituting theimage and is not necessarily limited to one scene or one cut.Association between the image material and the meta information will bedescribed later.

A musical piece DB 120 stores musical piece lyrics, sound source files,and meta information. The meta information of the musical piece includesgenres, titles, artists, lyrics display time with respect to musicalpiece time, for example. The genre or the like can be also estimated inadvance. For example, general impression word estimation by lyrics andgenre determination by acoustic data can be used. The general impressionword can be estimated by using the number of images searched by an imagesearch engine or the number of unique image contributors. The genredetermination by the acoustic data can be executed by classifyingobjects expressed by dimensional vectors by SVM (Support Vector Machine)classifying unknown data to each impression category on the basis oflearning data (see NPL 1 and NPL 2). The scenarios generated once andthe like can be stored with association with the musical pieces.Addition of musical pieces to be stored, update of information and thelike may be executed by using a communication function.

A situation estimating portion 130 estimates a situation expressed bythe musical piece by analyzing lyrics of the musical piece. As describedabove, it is possible to estimate scenes, situations and the likeexpressed by the musical piece lyrics by analyzing the text of thelyrics of the musical piece. As a result, an image accurately matchingthe musical piece can be specified.

The situation estimating portion 130 preferably estimates the situationexpressed by the musical piece by estimating contents of each categorycorresponding to the situation expressed by the musical piece. For suchestimation, the same meta information as the meta information to begiven to the image DB 110 in advance and the category applicable to 5W1Hcan be used.

For example, important words are extracted from all the paragraphs ofthe lyrics, and a category applicable to each item of 5W1H is set inadvance. Then, a discriminator such as SVM is prepared for each stateword (male, female, teen and the like) in the set category, and theinformation with positive lyrics input result can be used as the musicalpiece situation information. The musical piece situation may beestimated by putting emphasis on only two or three without using all the5W1H.

The image specifying portion 140 specifies at least one pivotal imagesuited for the estimated situation from the images constituted by thescenes each having the time-series order. As a result, a scenario of thesynchronized image can be generated by the scenes each having thetime-series order, and the synchronized image with a natural impressioncorresponding to the musical piece reproduction can be reproduced by thescenario. It may be so configured that a plurality of images isspecified and made the pivotal image. For example, assuming that an ORsearch is made from keywords selected from 5W1H such as male, spring,Mr., and island country, approximately 100 pieces of image can bespecified, it is possible to rank the images by calculating a degree ofrelevance between the meta information given to those 100 pieces and thekeywords, and thus the upper ranks can be selected as the pivotalimages.

A scenario generating portion 150 generates a scenario associating thescenes constituting the pivotal image with each section of the musicalpiece. That is, respective scenes specified as the pivotal images foreach musical piece section are combined. At that time, the scenario ispreferably generated while the time-series orders of the scenesconstituting the pivotal image are maintained. As a result, the scenarioof the synchronized image in which the scene is matched with eachsection of the musical piece can be generated while the time-seriesorders of a plurality of the scenes in the original pivotal image aremaintained.

The combination of a series of images of synchronized image is made bygeneration of a scenario format. The scenario format will be describedlater. Moreover, when each scene is associated with each musical piecesection, reproduction time of the scene is longer than the musical piecesection in many cases, but in that case, reproduction is performed fromthe beginning of the scene until time of the musical piece section haselapsed. If the image is not sufficient for the associated scene, it canbe complemented by the adjustment image.

An adjustment image specifying portion 160 extracts the keywords fromthe musical piece lyrics for each section of the musical piece andspecifies the adjustment image by using the extracted keywords. Theadjustment image may be a collection of scenes or may be a single scene.Since the keywords of the lyrics are basically used, the originalscenario is used without adjustment for the musical piece section inwhich there are no lyrics (introduction, interlude).

A scenario adjustment portion 170 adjusts the scenario by using theadjustment image while maintaining the time-series order of the imagespecified in the scenario. That is, by evaluating a degree of relevancebetween the adjustment image and the scene in the pivotal image, thepivotal image is modified in accordance with the evaluation. As aresult, the original scenario is complemented, and the diversifiedscenario more suited for the musical piece can be generated.

The scenario adjustment portion 170 compares the scene specified in thescenario with the adjustment image for each musical piece section on thebasis of the reference set in advance and preferably adopts either oneof them as the scene newly specified in the scenario. As a result, it ispossible to generate the scenario by adopting the favorable image moresuitable for the musical piece.

Moreover, the scenario adjustment portion 170 preferably modifies thecombination of the scenes specified in the scenario on the basis of theinformation stored in an evaluation information DB 195. As a result, thescenario of the synchronized image can be generated by reflecting user'sevaluation in it.

A reproduction portion 180 reproduces the synchronized image on thebasis of the scenario in synchronization with reproduction of thegenerated musical piece. As a result, it is possible to reproduce thesynchronized image suitable for the musical piece generated byautomatically combining the image. It can be used for the backgroundimage of Karaoke, for example.

An evaluation information collecting portion 190 collects evaluations onthe synchronized image from the viewers of the synchronized image basedon the generated scenario and stores the collected evaluations in theevaluation information DB 195. For example, regarding the evaluationinformation, an evaluation value can be obtained in binary values ofGOOD or BAD or in five ranks. Moreover, the evaluation value can beinput for the entire image or for each scene. The input evaluationinformation is associated with the scene, the entire image or thescenario and stored in the evaluation information DB 195.

The evaluation information DB 195 stores the evaluation information onthe synchronized image reproduced by the generated scenario. When thescenario of the synchronized image is adjusted in accordance with theevaluation, the evaluation information stored in the evaluationinformation DB 195 is extracted and used.

(Operation of Scenario Generation System)

Subsequently, an operation of the scenario generation system configuredas above will be described. FIG. 2 is a flowchart illustrating theoperation of the scenario generation system. Hereinafter, descriptionwill be made along steps S1 to S7 illustrated in FIG. 2.

(S1) Search of Pivotal Image

Image to be a pivotal image of the background image is searched in theimage DB 110. It is possible to search the image by using the keywordincluded in the musical piece situation information, for example. Onepiece of image matching the situation of the musical piece may besearched from the general impression word of the lyrics and theimpression word obtained from the lyrics lines (see NPL 1). Moreover,search can be made only for the image/scene including a person, theimage/scene not including a person and the like by filtering.

(S2) Musical Piece Sectioning

On the basis of the lyrics information, the musical piece is divided,and an ID is given to each musical piece section. For example, uniqueIDs such as Pp: introduction, P1-Pn: paragraph, Pi: interlude, and Pe:ending are given to the musical piece sections. Other than the above,the paragraph may be divided into plural parts. If P1 includes 5 lines,for example, P1-1 may be given as an ID for the first three lines, whileP1-2 may be given as an ID for the remaining two lines. The combinationis not limited to that.

(S3) Calculation of Scene Combination Candidate

In the scene information of the pivotal image, all the combinations arelisted up while the time-series order is maintained. For example, Pp:S1,P1:S3, P2:S4, . . . , Pe:S39 are listed up as the combinations of thescenes of the pivotal image.

(S4) Image Search by Lyrics KW

By using a KW (keyword) extracted from the lyrics lines included in themusical piece section P, the image is searched. If a plurality of imagesis searched, a search result can be narrowed by using an image with moreunique contributors (see NPL 1) or by filtering the meta information ofthe image. Moreover, by making random selection of the narrowed result,one piece of image for the section can be searched.

(S5) Comparison of Relevance Degree

The scene combined in the pivotal image and the image searched by thelyrics KW are compared by using each division section as a unit on thebasis of a comparison reference, and those matching the comparisonreference or having a higher numerical value are selected. As thecomparison reference, for example, (a) to (e) below and the like can beused:

(a) Those with smaller number of usage times;

(b) Those with lower degree of relevance (see NPL 1);

(c) Those with newer registration time and date;

(d) Those given more meta information; and

(e) Those with more number of evaluations or higher evaluation values inevaluation information DB 195.

(S6) Combination Modification by Evaluation Information

If the scene or the combination of scenes with lower evaluation valuesstored in the evaluation information DB 195 is included, it can bereplaced with another scene without using the searched scene. Forexample, the scene in the second rank in the relevance degree comparisonprocessing or the scene in the second rank in the search result issequentially used.

(S7) Scenario Generation

Finally, the image reproduced in the musical piece section is recorded.The generated scenario is recorded as a scenario format, and thescenario information can be generated by the format. The operation asdescribed above can be realized by executing a program.

(General Processing Image)

FIG. 3 is a view illustrating a processing image of generation andadjustment of a scenario. As illustrated in FIG. 3, first, the scenariogeneration system associates each piece of the pivotal image (imageconstituted by scenes Sp to Se) with the divided section of the musicalpiece. For the scenario obtained as above, the image is searched byusing a keyword obtained from the lyrics lines and images K1 to K4 areobtained. Then, the obtained images K1 to K4 are compared with S1, S2,S3, and S4, respectively, and the relevance degrees are evaluated. Asthe result of comparison of the relevance degrees, if the relevancedegrees are S1<K1, S2>K2, S3>K3, and S4<K4, the image specified by thescenario is replaced by the image with higher relevance degree (S1<->K1,S4<->K4).

(Association Between Image Material and Meta Information)

FIG. 4 is a view illustrating the relationship between the metainformation on the entire image and the meta information for each scene.As illustrated in FIG. 4, the meta information associated with the imagematerials stored in the image DB 110 has those for the entire materialsand those for each scene. For example, the meta information for theentire materials can be managed by an ID of 001, while the metainformation for each scene can be managed by 001-1, 2 and the like.

FIG. 5 is a view illustrating a table for associating the imagematerials with the meta information. For example, meta information suchthat changes are not available, the subjects are “cherry blossom” and“blue sky”, the place is “cherry blossom trees”, the season is “spring”,the time is “morning” and “daytime”, and a person is not shown isassociated with the image specified by the ID 001.

(Processing Example of Musical Piece Situation Information Estimation)

FIG. 6 is a flowchart illustrating a processing example of the musicalpiece situation information estimation. As illustrated in FIG. 6, first,learning of a discriminator is made in advance (step T1). Subsequently,morphological analysis is made for the lyrics of a specific paragraph(step T2). Then, on the basis of a word subjected to morphologicalanalysis, WHO estimation, WHAT estimation, WHEN estimation, WHEREestimation, WHY estimation, and HOW estimation are made (steps T3 toT8). On the basis of estimation results, an important word of the lyricsof the specific paragraph is extracted (step T9). Then, it is confirmedwhether the processing has been finished for all the paragraphs, and ifthe processing has not been finished for all the paragraphs, the processreturns to step T2. If the processing has been finished for all theparagraphs, the process is completed. The operation as described aboveis made possible by executing the program.

FIG. 7 is a view schematically illustrating the estimation processing ofan impression received from the lyrics. As illustrated in FIG. 7, agroup of general impression discriminators is learned by a lyrics forlearning DB in advance. Then, a feature word is extracted from thelyrics and is subjected to the general impression discriminator. Byconsidering word relevance of the obtained impression word, theimpression received from the lyrics is estimated.

For example, since words like “that girl”, “brother”, and “father” arefrequent in musical pieces from the male viewpoint, WHO can bedetermined to be “male”. Moreover, regarding WHEN, if words like“spring”, “winter”, and “thawing” are found in the lyrics, it can bedetermined to be a time of year when snow remains. Regarding WHY, anexpression like “Mom” and “five years have passed” leads to estimationthat “nostalgia” is the theme.

FIG. 8 is a table illustrating an example of the categories set inadvance and words expressing a state of each category. For example, if aresult of “male” discriminator is positive and “paid worker”discriminator is positive for the WHO items, “male” and “paid worker”are used as WHO information of the situation information. Thediscriminator can be configured by using the SVM (see NPL 2). Theestimation processing of the musical piece situation information can bedivided in application such as for the entire lyrics, each paragraph, oreach lyrics line. It is not always necessary to use all the estimationresults for matching. On the contrary, each combination can be alsoused.

(Image Specification)

FIG. 9 is a schematic view illustrating an example of the processing ofimage specification. As illustrated in FIG. 9, when the image issearched by using “male”, “spring”, “island”, “country”, “you”,“Japanese ballad”, and “hometown” as the main keywords by 5W1H, theimages 1 to 3 are searched as candidates. In them, the keyword and themeta information of the image 1 match each other most suitably, and theimage 1 has much related meta information and has no conflicting metainformation. On the other hand, though the image 2 has “northernprovinces”, “male”, and “winter” as related meta information, it has“fisherman” and “sea” as conflicting meta information, and in the image3, “male and female” is conflicting meta information to the related metainformation of “winter”.

(Scenario Format)

FIG. 10 is a table illustrating a scenario format example. The scenariogenerating portion 150 can generate scenario information by the formatas in FIG. 10, for example. A table 210 in FIG. 10 is a tableassociating the song name with the meta information with respect to themusical piece ID. In a table 220 in FIG. 10, the sections Pp to Peindicate sections of the musical piece. This scenario format specifiesthe contents of the scenario by start time, introduction and the like orlyrics, image ID of the pivotal image, the image ID of an adjustmentimage for each of the sections Pp to Pe.

CONCLUSION

The scenario generation system described above is preferably configuredby a client-server type system using the configuration other than thereproduction portion 180 as a server and only the reproduction portion180 as a client, in consideration of a processing capacity and aprocessing speed. Alternatively, it may be a form in which only thedatabase is used as a server, and the other configurations are used as aclient so as to utilize streaming or all the configurations may be usedas a client, and division to the server and the client is not limited.Moreover, in the description above, the image basically refers to movingimages but it may be a still image. Particularly, as the image to bereproduced in a period of time for approximately one line of the lyrics,even a still image does not give a sense of discomfort and can be usedeasily.

REFERENCE SIGNS LIST

-   -   100 scenario generation system    -   110 image DB    -   120 musical piece DB    -   130 situation estimating portion    -   140 image specifying portion    -   150 scenario generating portion    -   160 adjustment image specifying portion    -   170 scenario adjustment portion    -   180 reproduction portion    -   190 evaluation information collecting portion    -   195 evaluation information DB    -   210, 220 table

The invention claimed is:
 1. A scenario generation system used for imagereproduction synchronized with musical piece reproduction, comprising: asituation estimating portion that estimates a situation expressed by themusical piece; an image specifying portion that specifies at least onepivotal image suited for the estimated situation from images constitutedby scenes having a time-series order that are stored in an imagedatabase; a scenario generating portion that generates a scenarioassociating the scenes constituting the at least one pivotal image witheach section of the musical piece; an adjustment image specifyingportion that extracts a keyword from lyrics of the musical piece foreach section of the musical piece and that specifies an adjustment imageusing the extracted keywords; and a scenario adjustment portion thatadjusts the scenario by using the adjustment image by evaluating adegree of relevance between the adjustment image and a scene in the atleast one pivotal image, the degree of relevance indicating arelationship of meta information of the at least one pivotal image orthe adjustment image to the extracted keywords, the at least one pivotalimage being modified in accordance with the evaluation.
 2. The scenariogeneration system according to claim 1, wherein the scenario generatingportion generates a scenario associating the scene of the at least onepivotal image with each section of the musical piece while maintainingthe time-series order.
 3. The scenario generation system according toclaim 1, wherein the situation estimating portion estimates a situationexpressed by the musical piece by analyzing lyrics of the musical piece.4. The scenario generation system according to claim 1, wherein thescenario adjustment portion adjusts the scenario by using the adjustmentimage while maintaining the time-series order of the scenes specified inthe scenario.
 5. The scenario generation system according to claim 1,wherein the situation estimating portion estimates a situation expressedby a musical piece by estimating contents of each category correspondingto the situation expressed by the musical piece.
 6. The scenariogeneration system according to claim 1, wherein the adjustment imagespecifying portion compares the scene specified in the scenario with theadjustment image for each section of the musical piece on the basis of areference set in advance and adopts either one of them as the scenenewly specified in the scenario.
 7. The scenario generation systemaccording to claim 1, further comprising: an evaluation informationcollecting portion that collects evaluations on a synchronized image bythe generated scenario from viewers of the synchronized image; and anevaluation information DB that stores the collected evaluations, whereinthe image adjustment portion modifies a combination of the scenesspecified in the scenario on the basis of the evaluation informationstored in the evaluation information DB.
 8. The scenario generationsystem according to claim 1, further comprising: a reproduction portionthat reproduces the synchronized image on the basis of the generatedscenario.
 9. A scenario generation method for generating a scenario usedfor image reproduction synchronized with musical piece reproduction,comprising the steps of: estimating a situation expressed by a musicalpiece; specifying at least one pivotal image suited for the estimatedsituation in images constituted by scenes having a time-series orderthat are stored in an image database; generating a scenario associatingthe scenes constituting the at least one pivotal image with each sectionof the musical piece; extracting a keyword from lyrics of the musicalpiece for each section of the musical piece; specifying an adjustmentimage using the extracted keywords; and adjusting the scenario using theadjustment image by evaluating a degree of relevance between theadjustment image and a scene in the at least one pivotal image, thedegree of relevance indicating a relationship of meta information of theat least one pivotal image or the adjustment image to the extractedkeywords, the at least one pivotal image being modified in accordancewith the evaluation.
 10. A non-transitory computer readable recordingmedium having recorded thereon a scenario generation program forgenerating a scenario used for image reproduction synchronized withmusical piece reproduction, the scenario generation program causing acomputer to execute the processes of: estimating a situation expressedby a musical piece; specifying at least one pivotal image suited for theestimated situation in images constituted by scenes having a time-seriesorder that are stored in an image database; generating a scenarioassociating the scenes constituting the at least one pivotal image witheach section of the musical piece; extracting a keyword from lyrics ofthe musical piece for each section of the musical piece; specifying anadjustment image using the extracted keywords; and adjusting thescenario using the adjustment image by evaluating a degree of relevancebetween the adjustment image and a scene in the at least one pivotalimage, the degree of relevance indicating a relationship of metainformation of the at least one pivotal image or the adjustment image tothe extracted keywords, the at least one pivotal image being modified inaccordance with the evaluation.